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Abstract 

It is shown that a gauged SO(3) family symmetry can suppress flavor- 
changing processes from squark-mass non-degeneracy to an acceptable level. 
The potentially dangerous SO (3) D-terms can be rendered harmless if the CP- 
violating phases appearing in the SO(3)-breaking sector are small, which can 
naturally be the case if CP is a spontaneously broken symmetry. This approach 
has certain advantages over models based on global or non-abelian discrete sym- 
metries, and dovetails with some recent proposals for explaining the pattern of 
quark and lepton masses. Moreover this approach relates the near-degeneracy 
of the squark masses to an approximate CP invariance which can also explain 
the smallness of the electron and neutron electric dipole moments. 
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1 Introduction 



Non-degeneracy of squark masses can lead to "flavor-changing neutral currents" 
(FCNC) that are unacceptably large |]T[. In particular, the limits on the real and 
imaginary parts of the mass splitting between the and K$ suggest a near de- 
generacy between the d and s squarks 0, [|. Such a near degeneracy is hard to 
understand in the absence of some symmetry principle. The problem is made even 
more obscure by the fact that the quarks, far from exhibiting such a degeneracy, have 
a dramatic hierarchy of masses. 

A symmetry rendering s and d nearly degenerate must be non-abelian.§ It has 
been proposed in the literature || [7|, || that this role can be played by a family SU(2), 
or a discrete subgroup of it, under which the lightest two families form a doublet and 
the third generation forms a singlet. This is a structure consonant with both the 
presumed approximate degeneracy of s and d and the relatively large masses of t, b, 
and r. 

An SU(2) under which the families form a 2 + 1 cannot be gauged, as then the 
D-terms of SU(2) would directly contribute splittings to the squark masses compa- 
rable to the squark masses themselves. On the other hand, various arguments based 
on quantum gravity [IIJ seem to disfavor a global continuous symmetry below the 
Planck or string scale. This has led to the consideration of non-abelian discrete sym- 
metry groups |9|, [7| . However, since non-abelian discrete symmetries have up to now 
played little if any role in explaining particle phenomena, one may wonder if this is a 
completely satisfactory approach. 

In this letter we shall discuss the possibility that the three families form a triplet 
of a gauged SO (3). Because the representations of SO (3) are real it turns out that 
the troublesome D-terms vanish for real vacuum expectation values. If CP is spon- 
taneously broken then the SO(3)-breaking VEVs can, indeed, naturally be approxi- 
mately real. The squark-mass splittings then would be controlled by a naturally small 
CP-violating phase. This is very appealing since there are independent grounds for 
suspecting that certain CP-violating phases must be small in supersymmetric theo- 

1 Degeneracy of squark masses could also arise if supersymmetry breaking is communicated to 
the squark sector via gauge interactions. For models based on this idea, see Ref. 0. In this paper 
we shall be concerned with supersymmetry breaking via supergravity, in which case the squarks are 
not degenrate in general. For attempts to solve the squark-mediated FCNC problem using Abelian 
global symmetries, see Ref. ||. 
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ries. In particular, the one-loop contributions to quark and electron electric dipole 
moments are small Moreover, the severest constraint on the non- degeneracy 

of d and s — namely from the ex parameter — is greatly alleviated if the relevant 
CP-violating phase is small 0, H, ||, |7|, ||, || . 

In the kinds of models we shall discuss, the large third-generation quark and lepton 
masses arise from a VEV which breaks SO (3) down to an approximate SO (2). As 
will be seen, in spite of the fact that SO (2) is abelian, the splitting of s and d is 
sufficiently controlled. Indeed, since the families form a 2 + 1 (of course, reducible) 
under this residual SO (2), much of the discussion of squark mass splittings carries 
over with little change from the cases of SU(2) and its subgroups appearing in the 
literature. 

Some recently proposed models []12| have shown that quark and lepton masses can 
be accounted for without using symmetries that distinguish among the generations - 
all generations are treated on an equal footing ||13|| . In these models certain Yukawa 
couplings are vectors in "family space", that is they carry one family index. These 
models can be transposed very naturally into the context of a gauged family SO (3). In 
that transposition the Yukawa couplings that were vectors in family space are replaced 
by Higgs triplets of the SO (3). We will present an illustrative model that has a close 
affinity with that of Ref. ||12|| , and which we believe shows certain advantages of SO (3) 
over other groups that have been discussed. In the model discussed in Section 4.2, 
most of the observed features of the quark and lepton masses are explained by various 
aspects of SO(10) gauge symmetry, while the squark mass degenracy is understood 
with a (commuting) SO (3) family gauge symmetry. 



2 The FCNC Problem and Squark-mass Degen- 
eracy 

Introducing low-energy supersymmetry produces several problems JT], ^ |3], [TTJ, [H| 
connected with flavor violation and CP violation that are absent in the Standard 
Model. For purposes of discussion it is convenient to distinguish four of them, even 
though in particular models they are closely related. 

• (1) If the s and d masses are non-degenerate then mixing of s and d will lead, 
in general, to an excessively large Kl-K$ mass splitting, Amx- For maximal 
squark non- degeneracy ReMi 2 comes out about 10 4 times too large [|, Q . There 
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are somewhat less dangerous contributions (by about an order of magnitude) 
also from mixing of b with d. 

• (2) The same effect, if CP- violating phases are present, leads to an excessively 
large ImM 12 , that is to a too large ex- If the relevant phases are of order unity, 
then e K comes out about 10 7 times too big |fj, [3J. (The phases that are of most 
concern are those in the squark-mass matrix, although it should be kept in 
mind that CP-phases in the quark-mass matrix can show up in the gluino box 
diagram when one rotates the phase of the s quark to make the K° — > 7nr(I = 0) 
amplitude real.) 

• (3) Even with "universal" soft SUSY-breaking terms (i.e. degenerate squark 
masses and proportionality of A terms) the electric dipole moment of the neu- 
tron will receive contributions at one (gluino) loop if the A parameter or the 
/x parameter are complex. If these phases are of order unity, d n comes out 
typically about 10 2 times too big JTT|, |[]. 

• (4) Finally, even if A and fi are real, non-proportionality of the A-terms of the 
squarks to the quark Yukawa couplings gives a one-gluino-loop contribution to 
d n if there are phases in the quark mass matrix. If these phases are of order unity 
(as they need to be for the Kobayashi-Maskawa mechanism to work) typically 
d n is about 10 2 too big @. 

It should be noted that these problems have somewhat different origins. Problems 
(1) and (2) arise from non-degeneracy of squark masses. Problems (2) and (3) arise 
from CP-violating phases in the soft terms that break supersymmetry. Problem (4) 
comes from non-proportionality of the A terms. 

It is with problems (1) and (2) that we are primarily concerned in this paper. 
They are quantitatively the most severe and would seem to suggest a high degree of 
degeneracy of the squarks (especially d and s) no matter how CP is broken in the 
theory. (Indeed, problem (1) is a CP-conserving effect.) Our purpose in this paper 
is to propose an attractive explanation for this near-degeneracy. This explanation 
entails that certain CP-violating phases be small, which in turn suggests that CP is 
spontaneously broken. This fits in well with the requirements for solving problems (2) 
and (3), namely that the phases in the soft terms be small. However, neither squark 
degeneracy nor small phases in the soft terms will solve problem (4). The solution 
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of problem (4) requires further conditions on the theory, in particular on the sector 
that generates quark and lepton masses. This issue will be discussed in Section 6. 
For most of this paper, when we discuss the FCNC problem we will mean problems 



It should be noted that even if the squarks are non-degenerate at a high scale 
Mgut ( or Mpi) , some amount of degeneracy could arise in the process of renormal- 
ization group running from Mgut to the weak scale. This is a consequence of the 
gaugino loop corrections to the squark masses, which are flavor-blind. Similarly, the 
A terms could become proportional to the Yukawa couplings to some extent as a 
result of the RGE flow, even though they are non-proportional at Mgut- The squark 
masses and the A parameters at the weak scale (for the lighter two families) are given 



A 10% degeneracy in the squark mass-squared is not unreasonable to expect from 
the RGE flow (e.g: if Mq^Mqut) ~ M1/2), but this by itself is not sufficient to 
explain the constraints from the Kaon system. Similarly a 10% proportionality of 
the A terms and the Yukawa couplings is quite plausible (e.g: if Aj(Mgut) ^ M1/2). 
Since problem (4) noted above requires this proportionality to hold only to about 1%, 
it appears to us that (4) is a much less severe problem. 

The FCNC problem puts the most severe constraints on the degeneracy of the s 
and d. Let us define mg and rri£> to be the LL and RR mass matrices of the down 
squarks, respectively. And let V® and V D be the unitary transformations that take 
the squark mass matrices from the basis where the quark mass matrices are real and 
diagonal and where the gluino couplings are flavor-conserving to the basis where tuq 
and mo are real and diagonal. Then the constraint from the K^-Ks mass splitting 
is (for m Q ~ m- g ) @ 



(1) and (2). 



by 



Ai{m z ) 



m| i (M GUT ) + 7.2M 1 2 /2 
A(M GVT ) -4.1M 1/2 . 



(1) 




< 3.1 x 10 
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(2) 



The constraint from ex is that 



( 




sin0 < 1.9 x 10 



(3) 
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From mixing with b one has the condition (again from ex) that 
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ViM^Vg sin0' < 5 x 10- 8 . (4) 



m 2 Q ,m 2 D 



If d and s had maximal non-degeneracy, that is if Smn d/toq d ~ 1, and the phase 
were of order unity, then Eq. (3) would require that mg £ 200 TeV. 

In the models under discussion in this paper (and also those in Ref. JFJ) one has 
that 

/ 1 A 3 A 3 \ 

A 3 1 + A 2 A 2 m 2 , (5) 
V A 3 A 2 0(1) J 

where A n means 0(A n ), and where A = smOc ~ .22 is the Wolfenstein parameter. 
That means that in Eq. (2), ^m?Q D jm 2 Q D ~ A 2 and V^ ,D ~ A, and thus the condition 
there is easily satisfied for squark masses of order 100 GeV. The condition from the ex 
parameter, however, gives (Eq. (3)) that uiq > 10 3 A 3 a/sui TeV ~ 24 TeV ^sin 0, 
which implies that is of order 10" 3 or 10~ 4 . And in Eq. (4), V$' D ~ A 3 , V^ D ~ A 2 , 
so that rriQ > 4.5 x 10 3 A 5 v / sin 0' TeV ~ 2.3y / sTn0 7 TeV. Thus 0' must also be 
small. (As noted parenthetically where "problem (2)" was defined above, phases 
in the quark-mass matrix also contribute to ex indirectly through the gluino box 
diagram. In particular, the most dangerous contribution comes from a phase in the 
(12) or (21) elements of the quark-mass matrices. These also give the most dangerous 
contribution to problem (4). Thus whatever solves problem (4) tends to eliminate or 
lessen this problem as well. See the discussion in Sec. 6.) 

To see how such a form as Eq. (5) may be achieved using non-abelian family 
symmetry, it is helpful to review, at least in outline, a model proposed in Ref. 0. 

Consider a model with low-energy supersymmetry and the family group Gh, which 
is either SU(2) x U(l) x Z2 or some discrete subgroup thereof. The families are 
arranged in 2 + 1 representations of the non-abelian group: (Q + Q3), (d c + c/3), and 
{u c + M3), where the representations without the subscript '3' are understood to be 
doublets under the family group, and to contain the first two generations. Breaking 
the non-abelian family group is a doublet, which has VEV given by ($) = A(0, e) T . 
A is a scale characterizing new physics that is represented by higher-dimensional 
operators involving $ appearing in an effective lagrangian. The doublets, Q, d c , and 
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u c , all have charge 1 under the U(l), while the doublet $ has charge —1. The Higgs 
field $ is odd under the Z 2 as is a singlet Higgs field x- 

The third generation fermions are heavy because their masses arise from dimension- 
four terms: 

C° Y = h d d c 3 H d Q 3 + h u u c 3 H u Q 3 . (6) 

The next layer of the "onion structure" of the mass matrices is provided by the 
higher- dimension terms 



Cy - h d (d , d 3 ) hd QT Y/A 2 1 H d + {d^u} + h.C. (7) 



The singlet field x h &s VEV (%) = Ae x , where e x is of the same order as e. This gives 
the following structure to the down-quark mass matrix; 





id 



M d = /i| $ e 2 /i| x ee x ^(^d), (8) 
\0 ^ee x 1 / 

with a similar form for the up-quark and charged lepton mass matrices. From the fact 
that V c b and m s /m h are roughly the same and of order A 2 one sees that e ~ e x ~ A. 
However, this fact is not explained in this framework, since the fields x an d $ have 
different symmetry properties, and therefore there is no obvious reason why e and 
e x should be comparable. The SO (3) models, as we shall see, can do better in this 
regard. There are several ways to generate the first generation masses and mixings, 
but these are not of immediate concern to us. 

The leading contribution to the squark-masses come from effective operators 0, 15 
of the form 

£ S oft = / d 4 9Q^Qfjr,, (9) 



and others with Q replaced by Q3, d c , d 3 and so on. rj is a dimensionless "spurion" 
superfield which represents the effect of supersymmetry breaking, (rj) = msusY& 2 - 
The family symmetry, SU(2), or a discrete non-abelian subgroup of it, ensures that 
there is a degeneracy between the sparticle masses of the first two generations. 

There are a number of contributions to the non- degeneracy of s and d. One is 
from higher- dimension operators of the form J7|, [15] 

£' S oft = / d 4 9QU^Qrj V /A 2 , (10) 
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From the form of the VEV of $, and the structure of the mass matrix Ma, it is 
readily apparent that the effect of such a term is to generate a contribution to the 
mass-squared for s that is of order \ 2 rng USY . I* 1 other words, the fractional splitting 
between the d and s masses is of order 10~ 2 . This is true both of the splitting in the 
left-squark sector (given by the expression in Eq. (10)) and of the splitting in the 
right-squark sector (given by the analogous expression with Q replaced by d c ). There 
are other contributions to the squark mass splittings, but they are no larger in order 
of magnitude than this. 



3 SO (3) Breaking and the Effect of the D-Terms 

Consider a gauged SO(3) symmetry broken spontaneously by a set of M vectors: A it 
% — 1, ...,M. Assume that the left and right-handed (s) quarks and (s)leptons are all 
in vector representations of SO(3), which we will generically denote by <p n . The SO(3) 
D term in the potential then has the form 



vb(^) = E( £, °) 



a=l 



Note that the generators of SO (3) in the vector representation can be written using 
the familiar cross product. It is clear that if the VEVs that spontaneously break 
SO(3) contribute non-vanishingly to the SO(3) D-term, the cross terms in Eq. (11) 
will lead to intergenerational splittings of the squark masses. It is this that has made 
gauged continuous family symmetries disfavored as a solution to the squark-mass non- 
degeneracy problem. However, it is obvious that if CP were conserved, the VEVs of 
the vectors would be real and would contribute nothing to the dangerous D-terms, 
since A* x A { = 2iA iR x An. 

Since the SO (3) D-terms break supersymmetry, they must be proportional to 
m susY- Thus one expects that the splittings among the mass-squared of the squarks 
due to these D-terms will be of order dcP m2 susYi where dcp represents the magnitude 
of the CP- violating phases appearing in the potential of the vectors A^. Since the 
overall magnitude of the squark masses is itself of order msusY, the D-term contri- 
butions to the fractional splittings 5m?Q/m?Q and Sm 2 D /m 2 D appearing in Eqs. (2) and 
(3) are of order Qcp- In a theory in which CP is spontaneously broken, these phases 
can be naturally small. 
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To be more explicit, let us assume that there are three vectors, Ai, i = 1,2,3, 
which break SO (3) spontaneously at a scale A which is near the Planck scale. Since 
we will assume that the superpotential for these fields has CP-violating phases which 
are very small, we can expand the VEVs of the vectors Ai in powers of this CP 
violation. In particular, we can write 

(A l ) = Af )) +tb z + 0(6 2 CP ), (12) 

where A\ is the VEV in the limit that the CP-violating phases are set to zero. The 

— * 

imaginary parts of the VEVs, bi, are thus of order 9 C p. 

Clearly, if we neglect the soft, supersymmetry-breaking terms that are of order 

— * 

the weak scale, the VEVs of the Ai must make what remains of the potential, namely 
the F-terms and D-terms, vanish — otherwise supersymmetry would break at the 

— # 

scale A ~ M Pi . The F terms can only depend on the Ai through the six SO (3)- 

— * — * 

invariant complex quantities Ai • Aj. Thus their vanishing gives 12 real conditions to 
be satisfied. (Another way to argue this, which applies to any number, M, of vectors, 

— * 

is that the Ai contain 6M real quantities, but the superpotential, being holomorphic, 
is invariant under the complex extension of SO (3), and so 6 of the parameters are left 
undetermined by the F terms. Thus 6(M — 1), in our case 12, conditions are imposed 
by the F terms.) These can be written to leading order in CP violation 



?(») 



$< » + (13) 



■ A , 



•(0) 



where 6i and % are combinations of CP-violating phases appearing in the superpo- 
tential, and are of order 9cp- 

— * 

The D-terms depend only on the real three- vector D, and so their vanishing gives 
3 more real conditions, which can be written to leading order in CP-violation as 

E^ 0) x^ = 0- (14) 

i 

— * 

But the three vectors Ai have 18 real degrees of freedom, of which three are gauge 
degrees of freedom. Thus there are 15 conditions to be satisfied by 15 parameters, 
and there is in general a non-trivial solution to Eqs. (13) - (14). This solution can be 
expressed schematically as b ~ 9 C pA^. The D-term in the potential can be written 

2 

in the same schematic way as V D ~ gA^(b — 9 C pA^) + g<p* n T(j) n . g is the SO(3) 



8 



gauge coupling constant, and r is an SO(3) generator. When the soft supersymmetry- 
breaking terms are added, one has effectively a potential for hi that can be written as 
V(b) ~ g 2 {A^) 2 {b - 6cpA<®) 2 + m 2 \b\ 2 . This gives g 2 (A^) 2 (b — 9 C pA^) ~ ra^b ~ 
OcpTTIqA^. Therefore the contribution to the squark and slepton mass splittings are 
of order g 2 A^\b — 9cpA^)((f)* n T(j) n ) ~ QcP m \Wn T< \ ) n)- This verifies our earlier claim 
that the fractional squark-mass splittings due to the SO (3) D-terms are simply of 
order the CP-violating phases that appear in the superpotential of the vectors that 
break SO(3). Observe that the SO(3) gauge coupling drops out. 

A more careful treatment can be done that gives the order in A of the contribu- 
tions to the different squark- mass-matrix elements coming from these SO (3) D-terms. 



Suppose that A\ 



A, 



A 2 , and 



A, 



A 3 , and that A\ lies approximately 



in the '3' direction in family space, A 2 lies approximately in the '2-3 plane', and A 3 
has components in all three directions, with the direction cosines A\ ■ Aj all being of 
order unity. (These conditions apply to the types of models described in the next 
section.) Then it can be shown that the SO (3) D-term contributions to the squark 
masses are of order C pm 2 SUSY (0(A 2 ), 0(A 3 ), 0(A)) • x Q. In particular, writing 
Q = (d L ,s L ,b L ), 



Q^m 2 Q Q = (d L ,s L ,b L y 



1 




1 


A 3 + i9 C p\ 


A 3 + ie C p\ 3 \ 




( d L 






A 3 


— iO C p\ 


1 + A 2 


A 2 + ^ CP A 2 




sl 




\ 


A 3 


- t9 C p\ 3 


A 2 - i6 C p\ 2 


0(1) J 




V h 


) 



(15) 



where, as before, A™ means 0(X n ). The real parts come from other sources, to be 
discussed later. The imaginary (CP-violating) parts come from the SO (3) D-terms. 

— * — ■ — ■ 

There are similar matrices for D c = (d c L , s c L , b c L ). 

Since we know that to satisfy the condition on the real part of M 12 in the Kaon 
system (Eq. (2)) the d*s and s*d elements of rriq D must be 0(A 3 ), one sees from Eq. 
(15) that 9 C p must also be no larger than 0(A 2 ). Moreover, from Eq. (15) it is easy 
to see that the phase <p in Eq. (3) is arg{[0(A 3 ) + iO(9 CP \)] 2 } ~ 9 CP /X 2 . Thus, to 
satisfy the condition on e K one needs 9 C p ~ 1CT 4 . 

It is noteworthy that CP-violating effects from squark mixing involving the third 
generation is more highly suppressed. The constraint arising from the (CP-conserving) 
B d — Bd system is 



'TeVV 



vSSmiVg V°5m 2 D Vi 



m 2 D 



< 1.3 x 10" 3 . 



(16) 
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From the form of Eq. (15), noting that Smq/rriQ ~ 0(1) for the b — d system, we see 
that the quantity on the left-hand side of Eq. (16) is approximately A 6 ~ 1 x 10 -4 . 
This clearly satisfies the constraint. As for the CP-violating effects, note that they 
arise with additional factors of 6cp and are thus extremely small. 

4 Types of Models 

We may distinguish two approaches to constructing realistic models using an SO (3) 
family gauge symmetry. What we will call Approach I is similar in effect to models 
with abelian continuous or discrete family symmetries that distinguish among the 
generations. This approach can lead to "texture" models of fermion masses. The 
main difference here is that in our case we are using gauged SO (3) symmetry to arrive 
at such forms. Approach II is similar in effect to models based on "factorization" of 
Yukawa terms p], [13], pf. 

4.1 Approach I: Texture models 

— * — * 

Let there be a set of vectors which break SO(3) spontaneously. We will call them A, B, 
C, etc. (instead of Ai as heretofore). One can imagine that the superpotential of these 
vectors is such as to make the VEVs of any pair of them either orthogonal or parallel.! 
Each vector can be taken to define a direction in "family space" corresponding to a 
particular generation (before diagonalizing the fermion mass matrices). For example, 
A might be the longest vector and be involved in giving mass to the heavy third 
generation through effective terms like A ■ D C A ■ QH, etc. Thus A would define the 
'3' direction in family space, and this term would be A 2 d^Q 3 H. Since the VEVs of 
B and C are orthogonal to that of A and to each other, they can be taken to define 
the '2' and '1' directions in family space. Thus a (21) element would come from 
B ■ D C C ■ QH = BC(d c 2 Qi)H . 

A set of discrete symmetries that distinguish among the vectors A, B, C, etc. 
would effectively be equivalent to a set of discrete symmetries that distinguish family 
generation number. Consider, for example, a set of Z 2 symmetries, x Kb X Kq, 
where '■ A — ► —A, B — > +B, C — > +C, and similarly for Kb and Kq- If 

2 Fairly simple superpotentials lead to this result. For example, the superpotential W — Yli=i Ai • 
Ai + El^i(Ai ■ Aj) 2 has a SUSY preserving minimum where A3 ~ (0,0,1), A2 ~ (0,1,0), A\ ~ 
(1,0,0).' 
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one had a scalar field that had parity (— , — , +) under Ka x Kb x Kq then it could 
couple to B ■ D C A ■ Q and A • D C B ■ Q and therefore in the (23) and (32) elements of 
mass matrices but not in others. If this scalar is a GUT non-singlet (such as a 45 of 
SO (10)), it will not upset the desired VEV pattern of the three SO (3) vectors. In such 
a way "texture" models could be constructed of the quark and lepton mass matrices. 
So, although one does not actually have an abelian family symmetry Z 2 x Z 2 x Z 2 
one achieves the same result. More complicated discrete family symmetries can be 
simulated in the same way. 

It should also be noted that the kind of discrete symmetry suggested above could 
explain why the vectors A, B, C, etc., have VEVs that are orthogonal or parallel. 
For example, a term in the superpotential of the form MA ■ B would be forbidden, 
and (A ■ B) 2 /M allowed. If terms of yet higher dimension can be neglected then 
@ab — tvk/2. On the other hand, if both these terms were present Qab could take 
non-trivial values. 

As an example of an SO(10) model in this approach, consider the couplings 
W = (16 • A)T6 A + (16 • B)16 B + (16 • C)16 c + 16« 16 a + 16al6 Q 10 

a=A,B,C a=A,B,C 

where 16^ carries Ka charge etc. For generation mixing, we utilize the couplings 
16^16^45^ where 45 ab has both Ka and K B charges, etc. When the 16 a,b,c + 
16a,b,c are integrated out, light fermion mass matrices with specific textures will 
emerge. 

4.2 Approach II: Factorization models 

Another way to explain the hierarchy of quark and lepton masses that has been pro- 
posed in the literature |T^, |T2| and that does not involve abelian family symmetry, 



is the idea of the "factorization" of fermion mass matrices. If the Yukawa couplings 
are matrices in family space, like Fij{QiQjH), then one expects mass matrices 
of rank 3 with no particular hierarchy among their eigenvalues. On the other hand, 
if one has a factorized form like FiFjiQiQjH), then no matter in what direction 
Fi and F'- point the mass matrix is rank 1. If this were the dominant term it would 
explain why one family is much heavier than the others. A second (by assumption 
smaller) term GiGj(Q^QjH) would, together with the previous term, automatically 
give a mass matrix of rank 2 (unless G \\ F or G' \\ F'). And similarly a third term 
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would give mass to the remaining generation. The crucial point is that no special 
relative directions or absolute directions for the vectors Fi, Gi, etc., need be assumed. 
In a sense, the basic idea of factorization is opposite to that of abelian continuous or 
discrete family symmetry: the whole idea is not to specify a priori special directions 
in family space. 

The way such factorized forms arise in the models proposed in the literature 



lq , |13| , pT2j] is through integrating out heavy fields. For example, if there are the 



terms M\l/ C \l/ + F i ^ c Q i (il) + F(df^{H), where M and (fi) are comparable and large, 
then integrating out \l/ c + \I/ gives the effective term FiFj((Q) / M)Qid C jH . 

It is easy to see that one may implement this factorization idea readily in the 
context of SO (3) family gauge symmetry. One simply has to promote the Yukawa 
couplings that are vectors in family space to be the VEVs of Higgs fields that are 
triplets of SO (3). One actually achieves more flexibility in doing this, because in the 
models |16| , [13| , [T2| where the Yukawa vectors are just numbers, they must have (bar- 
ring fine-tuning) arbitrary relative directions, whereas here more than one "Yukawa" 
vector could come from the same SO (3) Higgs triplet and so be aligned. 

Here we will present an SO(10) model with SO(3) gauge family symmetry that 
is similar to that proposed in Ref. [12|], which explains in an economical way many 
features of the quark and lepton spectrum, and which solves the problem of FCNC 
coming from squark-mass non-degeneracy. For helpful background the reader is re- 
ferred to Ref. H . 

In this example model, as in Ref. ||12|| , the nontrivial pattern of quark and lepton 
masses is a consequence of the mixing of the three families with new vectorlike family- 
antifamily pairs. In particular, we posit the existence of an SO (3) triplet of families, 
16, and a set of fields which are singlets under SO(3) but transform under SO(10) 
as the vectorlike pairs 16 + 16, and 16' + 16', and the real representations 10 + 10'. 
Involved in the Yukawa terms of the quarks and leptons are the Higgs fields 45 h, 
45x, 45b-L) 16//, and 10//. The two adjoint Higgs point respectively in the X and 
B — L directions, where X is the SU(5)-singlet generator. (The field 45// which is 
assumed to have a VEV in a general direction need not be distinct from 45^, but 
its VEV cannot be strictly along the B — L direction, see below.) The 16// gets a 
GUT-scale VEV in the SU(5)-singlet direction and a weak-scale VEV in its ordinary 
weak-doublet component. The 10// also breaks the weak interactions. 
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The Yukawa terms of the quarks and leptons follows: 

Yukawa = a M16l6 + (a ■ 16)T6(45 H ) + (a ■ 16)16(10/,) 

6 16 / T6'(45x) + (6-16)IS'(45fl_i) + (b' ■ 16)16'(10h) (17) 
c 1010'(45x) + (c- 16)10(16//) + (d ■ 16)10'(16 H ) 

The vectors a, b, b', c, and d at this level are just coupling constants which explicitly 
break SO (3), but they are to be understood as arising from the VEVs of SO(3)-vector 
Higgs fields in an SO(3)-invariant theory. The same vector a appears in two terms, 
and can be taken without loss of generality to point in the '3' direction. (These 
vectors are real, for reasons explained above, to order 10 -4 .) The two vectors b and 
b' are assumed to be coplanar with a and can without loss of generality be taken to 
lie in the '2-3 plane'. The vector c (and/or d) has a component in the '1' direction. 
This pattern will be shown to arise naturally from the underlying theory with SO (3) 
family symmetry. 

The first set of three terms in Eq. (17) generates mass for the third generation. 
Integrating out the 16+16 gives an effective term of the form (QaM6)(a-16)(10//)/a , 
where Q is the generator of SO(10) that tells which direction (45//) points in. It is 



easy to show |T2[ that, no matter what Q is, = m T at the GUT scale. The 
second set of three terms generates the next layer of the onion, namely masses for 
the second generation. Integrating out the 16' + 16' one obtains an effective operator 
approximately (for small mixing) of the form (— =^&-16)(&'-16). For fermions of type / 
(/ = u, d, I) this term gives (M/)y oc (~f^J hbj + (^^) bjb\. For the down-quark 
and charged-lepton mass matrices, this gives non-zero contributions to the (22), (23), 
(32), and (33) elements that are all of the same order (assuming that the vectors b 
and b' point in arbitrary directions in the (23) plane). The second generation masses, 
then, come predominantly from the (22) elements, and V c b ~ m s /mb ~ A 2 . Moreover, 
because of the factor of B — L, the entries in the lepton mass matrix are three times 



as large as those in the down-quark mass matrix. This gives the Georgi-Jarlskog p7 
factor of 3 between the /x and s masses. 

On the other hand, because X is the same for u and u c , while B — L is opposite 
in sign, it is obvious that the contribution of this term to the up-quark mass matrix 
is anti- symmetric. Therefore the (22) element of M u vanishes, and the c mass comes 
from mixing with the third generation. Thus m c /m t ~ A 4 m s /mb, as observed. 

Finally, the last set of three terms in Eq. (17) generates the first generation masses 
and mixings. It is easily shown that the effective operator gotten from integrating out 
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the 10 + 10' is (if mixings are small) antisymmetric | 12| . This can be seen from the 
fact that, because the 45 is antisymmetric, the effective operator changes sign when 
one interchanges the 10 and 10'. This also interchanges c and d and thus the rows 
and columns of the mass matrices. This antisymmetric contribution is only to the 
down-quark and lepton mass matrices. Because the 10 of SO(10) does not contain 
up quarks, there is no contribution from this effective operator to the up-quark mass 
matrix. 

One has therefore accounted for several more facts. The relative smallness of 
m u /m t is a consequence of the up-quark matrix still being rank-two at this level. 
The facts that the (11) elements vanish and that the (12) and (21) elements are 
equal in magnitude lead both to the familiar relation tan = ^Jmd/m s , and to the 
Georgi-Jarlskog factor of | between the e and d masses (since Det(M d ) ~ Det(Mi)). 

Let us now turn to the underlying SO(3)-invariant theory. There must be at least 
three SO(3)-vector Higgs, which again shall be called A, B, C, etc.. The Yukawa 
coupling constant a comes from the VEV of A. So the second term in Eq. (17) comes 
from a higher- dimension term (a/A) (A ■ 16)1645x- a is just some dimensionless 
coupling, and A ~ Mpi. Similarly, for the third term in Eq. (17). Because the 
effective Yukawa coupling of the top quark is about 1, it is easily seen that (A) rs A. 
The Yukawa constants, b, b', c, and d come from the VEVs of B and C . Because these 
lead to smaller quark and lepton masses, it is natural to assume that these VEVs are 
somewhat smaller than A. For example, from the earlier discussion one expects that 
(B)\ 2 /A 2 ~ m s /m b ~ A 2 . 

Clearly, there must be some symmetry that distinguishes the three fields A, B, 
and C, or else they would couple indiscriminately and destroy the specific pattern 
in Eq. (17). A simple possibility is K\ x Kb x Kg, where each K is a Z 2 which 
reflects one of the vectors. By means of this symmetry one can ensure that at the 
dimension-four level only the vector B appears in the fifth and sixth term of Eq. (17). 
However, at the dimension-six level one can have also (B ■ A/ A 2 ) A, which is of the 
same order as B, and has the same transformation properties under K& x Kb x Kq- 
Thus the effective Yukawa couplings in the fifth and six terms of Eq. (17) will be 
(different) linear combinations of B and A. Vectors a, b, and b' will be approximately 
coplanar, and the angles between them will be order unity, as desired. (There will 
also be contributions of order (B ■ C/A 2 )C, but these will be negligibly small.) 

In the eighth and ninth terms of Eq. (17) one must have C and another vector 
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D (which could be B) at the dimension-four level. Then c arises predominantly from 
C and (C ■ A/ A 2 ) A, and lies approximately in the A — C plane. Similarly, d arises 
predominantly from D and (D ■ A/ A 2 ) A and lies approximately in the A — D plane. 
With this arrangement the full rank-three mass matrices of the quarks and leptons 
are generated. From the magnitude of the first generation masses it is reasonable to 



assume that 



(C) x (D) 



A 3 . 

It is apparent that the scenario outlined above requires that the VEVs of the 
vectors A, B, C, etc. must have some non-trivial relative orientation; they cannot 
be nearly parallel or nearly orthogonal. Superpotentials leading to this situation are 
easy to construct. Consider, for example, the angle between A and B. As noted 
above, if there are both linear and quadratic terms in (A ■ B) then a nontrivial angle 
will in general result. However, while the term (A ■ B) 2 / A is allowed by x Kb, 
MA ■ B is not. This problem is overcome if there are singlet fields, A and B , that 
are odd under K& and Kb respectively, and whose VEVs are of the same order as (A) 
and (B). Then a term of the form A B (A ■ B)/A is allowed. Another possibility is 
to utilize the coupling A x B ■ C which is invariant under the discrete symmetries. 
This term will induce non-trivial angles between the vectors. Yet another possibility 
is to use a singlet <fi which is odd under all three parity symmetries, this can have an 
invariant coupling A x B • C(f>, which will again induce non-trivial angles between the 
vectors. 



5 The Lifting of the Squark-mass Degeneracy 

How big will the violations of squark-mass degeneracy be? We will discuss this 
in the context of the SO(10) example presented in the last section. The dominant 
contribution to the d-s non-degeneracy, in complete analogy with the "SU(2)" models 
discussed in Sec. 2, comes from effective terms of the form 



£ soft = J tfei^ ■ B$ • I67777/A 2 . 



2 



Since we know from the discussion of the last section that (B) /A 2 ~ m s /m b ~ A , it 
follows that this term will contribute 0(A 2 ) to the (22), (23), (32), and (33) elements 
of the squark mass matrices, which is consistent with Eq. (4) and sufficiently small. 
This is the same result that obtains in the models based on SU(2) and its discrete 
subgroups. 



15 



In the kinds of models described in the last section the large VEV of A breaks 
SO (3) down to an approximate SO (2). Since this is abelian one might wonder whether 
this residual symmetry will be sufficient to protect the near-degeneracy of the s and 
d squarks. The dangerous operator that is allowed by SO (3) (and which has no 
analogue in the models based on SU(2) and its subgroups) is 

J d 4 6{Vz ■ A x 16)^/A. (19) 

While this is invariant under SO(3), it is odd under Ka- However, at least in the mod- 
els of Approach II, an allowed and equally dangerous term is gotten by multiplying 
the above operator by A /A. 

Fortunately, this dangerous class of operators can be forbidden by going to the 
gauge group 0(3), instead of SO (3). In other words, by adding the Z 2 under which all 
vectors of SO (3) are odd. Then the dangerous operator of Eq. (19) can only be made 
even under this Z 2 by putting in an odd number of additional factors of SO(3)-vector 

— * — * — * 

fields. But this, in turn, is only possible using the "triple product", A- B xC. Hence, 
the lowest operator of the type shown in Eq. (19) is 

J d 4 0(l^ • A x 16)(A- B x C)B C r]ri/A 4 , (20) 

which is 0(^^m 2 SUSY ) ~ 0(A 5 ) and therefore negligible. 

To avoid problems in the Kaon system it is also necessary to ensure that the 
mixing of b with s and d be sufficiently small, and in particular of order A 2 and A 3 
respectively. (See Eq. (5).) The b-s mixing comes both from Eq. (16) (which we 
have seen is not dangerous) and from effective operators of the form 

J d 4 6{l^ -A){B- 16) (A- B or A B )rjrj / A 4 . (21) 

Note that one had to go to order A -4 to get an operator that is invariant under 
Ka x K B - This gives a result for the mixing that is of order A 2 , as required. (The result 

— * — * 

is even smaller in Approach I models where A ■ B vanishes (at least approximately) 
and where there is no need for the fields A and B .) 

— — — * 

The b-d mixing comes from operators of the same form as Eq. (21) with B and 
B replaced by C and Cq. The resulting mixing is typically of order A 3 as required. 
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6 The Breaking of CP and Electric Dipole Mo- 
ments 



So far we have an explanation using spontaneously broken SO (3) and CP for the 
apparent near-degeneracy of the squarks of the first two generations. Since that 
explanation involves certain CP-violating phases being naturally small, one can get 
"for free", as it were, a solution to problems (2) and (3) discussed in section 2. 
However, this does not solve problem (4), since the family SO (3) does not make 
the A-terms proportional to the Yukawa terms. Moreover, even if the phases in the 
SO(3)-breaking VEVs, the squark masses, the A parameter (s) and \i are naturally 
very small, the Kobayashi-Maskawa mechanism requires that some phase in the quark 
mass matrices be of order unity. (There is no conflict here with the assumption that 
SO (3) breaking VEVs are approximately real, since order one complex phases can 
arise from the SO(10) breaking sector.) This would lead in general to d n being about 
two orders of magnitude too large. As noted already, RGE running can introduce 
some proportionality, of order 10% or so between A and the Yukawa couplings, so the 
tuning needed is only about 1/10. This may not be a serious difficulty. Nevertheless, 
let us elaborate on some other alternatives to avoid problem (4). 

There are several ways around this problem. The most radical is simply to aban- 
don the Kobayashi-Maskawa mechanism. That is, one lets the phases in the quark 
mass matrices be small also. This does not create a problem in explaining since 
the gluino-box diagrams that were the source of problem (2) can do that — indeed we 
have had to assume that certain phases were about 10~ 4 to avoid e# being too large. 
However, these box diagrams will not give e'/e near the present experimental limit. 
If e' is indeed near the present limit, one would have to invoke some new mechanism. 
One possibility is that spontaneous CP violation occurring in the Weak scale Higgs 
sector could give milliweak-type effects. Since it is not necessary that these give a 
significant contribution to (which is already assumed to be taken care of by gluino 
loops) it would seem possible that Higgs effects could generate e' and d n of the right 
magnitudes. 

It is also possible to maintain the Kobayashi-Maskawa explanation of the Kaon- 
system CP violation. According to Ref. |14[ one needs, in order to solve problem (4), 
that the quark mass matrices (and A-terms) have a special form. In particular in is 
helpful if certain off-diagonal elements vanish [14]. But we have already seen that 
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in Approach I models can be constructed with non-trivial "textures" for the fermion 
mass matrices. 

It is somewhat trickier to solve problem (4) in models which are based on Approach 
II while maintaining the KM mechanism. However, it is possible to do so, as we shall 
show by a slight modification of the SO(10) model presented above. 

Suppose that the effective Yukawa couplings c and d in Eq. (17) arise (at 
dimension-4 level) from the same SO (3) vector Higgs, C. Then both c and d lie 
in the A-C plane (approximately). To the extent that this approximation is good, 
the last three terms in Eq. (17) will only generate (13), (31), (23), and (32) elements. 
These elements of the down-quark mass matrix can have phases that are large, with 



reasonable values of squark masses, without leading to an excessive d n W% - Thus by 
introducing a large phase into some VEV that appears only in one of the last three 
terms in Eq. (17), one can get a large KM phase, 5k, without creating a difficulty. 
However, a large phase in the (12) and (21) elements of the quark mass matrices 
would be fatal ||14|| . But with the new assumption we have made one can show that 
the (complex) contribution to these elements from the last three terms of Eq. (17) is 
only of order A 5 . One still needs to generate a real contribution to the (12) and (21) 
that is of order A 3 to give first generation fermion masses and the Cabibbo angle. 
This can be done by introducing a new set of terms analogous to the last three in Eq. 
(17) but which do not have a large phase. 



7 Conclusions 

We have suggested in this paper that a gauged SO (3) family symmetry can cure 
the FCNC problem arising from the squark mass non-degeneracy. What enabled us 
to gauge the SO (3) symmetry is the near-vanishing of the SO (3) D-terms, which 
potentially could have contributed at an unacceptable level to the squark mass non- 
degeneracy. Since triplet representation of SO (3) is real, any non-zero D-term con- 
tributions to the squark mass splittings can only arise proportional to CP-violating 
phases in the triplet VEVs. If CP violation has a spontaneous origin, which may 
be desirable from other considerations (EDM of the neutron and the electron), these 
phases can be naturally small. We showed how it is possible to transcribe certain 
recently suggested fermion mass schemes based on SO(10) symmetry into this SO(3) 
framework. The SO (3) family symmetry can also mimick Abelian symmetries en- 
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abling one to construct texture models of fermion masses. 
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